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Abstract —We consider the problem of finding the mlnimnm 
sum-rate strategy in cooperative data exchange systems that do 
not allow packet-splitting (NPS-CDE). In an NPS-CDE system, 
there are a number of geographically close cooperative clients 
who send packets to help the others recover a packet set. A 
minimum sum-rate strategy is the strategy that achieves universal 
recovery (the situation when all the clients recover the whole 
packet set) with the the minimal sum-rate (the total number of 
transmissions). We propose an iterative merging (IM) algorithm 
that recursively merges client sets based on a lower estimate of 
the minimum sum-rate and updates to the value of the minimum 
sum-rate. We also show that a minimum sum-rate strategy can be 
learned by allocating rates for the local recovery in each merged 
client set in the IM algorithm. We run an experiment to show 
that the complexity of the IM algorithm is lower than that of 
the existing deterministic algorithm when the number of clients 
is lower than 94 . 


I. INTRODUCTION 

Due to the growing amount of data exchange over wireless 
networks and increasing number of mobile clients, the base- 
station-to-peer (B2P) links are severely overloaded. It is called 
the ‘last mile’ bottleneck problem in wireless transmissions. 
Cooperative peer-to-peer (P2P) communications is proposed 
for solving this problem. The idea is to allow mobile clients 
to exchange information with each other through P2P links in¬ 
stead of solely relying on the B2P transmissions. If the clients 
are geographically close to each other, the P2P transmissions 
could be more reliable and faster than B2P ones. 

Consider the situation when a base station wants to deliver 
a set of packets to a group of clients. Due to the fading effects 
of wireless channels, after broadcast via B2P links, there may 
still exist some clients that do not obtain all the packets. 
However, the clients’ knowledge of the packet set may be 
complementary to each other. Therefore, instead of relying on 
retransmissions from the base station, the clients can broadcast 
linear packet combinations of the packets they know via P2P 
links so as to help the others recover the missing packets. 
We call this kind of transmission method cooperative data 
exchange (CDE) and the corresponding system CDE system. 

Let the universal recovery be the situation that all clients 
obtain the entire packet set and the sum-rate be the total 
number of linear combinations sent by all clients. In CDE 
systems, the most commonly addressed problem is to find 
the minimum-sum rate strategy, the transmission scheme that 
achieves universal recovery and has the minimum sum-rate. 


This problem was introduced in ||T1. Randomized and de¬ 
terministic algorithms for solving this problem have been 
proposed in 121, S and 111,151, respectively. The idea of the 
randomized algorithms in 121, H] is to choose a client with the 
maximal or non-minimal rank of the received encoding vectors 
and let him/her transmit once by using random coefficients 
from a large Galois field. But, these randomized algorithms 
repetitively call the rank function, the complexity of which 
grows with both the number of clients and the number of 
packets. On the other hand, the authors in Q, l5] propose 
deterministic algorithms where the complexity only grows 
with the number of clients. But, we will show in this paper 
that the divide-and-conquer (DV) algorithm proposed in H 
can not be applied to CDE systems that do not allow packet¬ 
splitting (NPS-CDE). Although the deterministic algorithm in 
151 can solve NPS-CDE problems, it relies on the submodular 
function minimization (SEM) algorithm, and the complexity 
of SEM algorithms is not lowQ 

In this paper, we first use a counter example to show that 
the DV algorithm in ID can not solve the NPS-CDE problems. 
We then propose an iterative merging (IM) algorithm, a 
deterministic algorithm, for finding the minimum sum-rate 
and corresponding strategy in NPS-CDE systems. The IM 
algorithm starts with an initial lower estimate of the minimum 
sum-rate. It recursively merges the clients that require the 
least number of transmissions for both the local recovery and 
the recovery of the collectively missing packets0 The IM 
algorithm updates the estimate of minimum sum-rate whenever 
it finds that the universal recovery is not achievable. We prove 
that the minimum sum-rate can be found by starting the IM 
algorithm. We also show that a minimum sum-rate strategy can 
be determined by allocating transmission rates for the local 
recovery in each merged client sets in IM algorithm. We run 
an experiment to show that the complexity of the IM algorithm 
is lower than that of the deterministic algorithm proposed in 
0 when the number of clients is lower than 94. 


^ There are many algorithms proposed for solving SFM problems. To our 
knowledge, the algorithm proposed in has the lowest complexity 0 {K^ • 
7 + K^), where K is the number of clients, and 7 is the complexity of 
evaluating a submodulai' function. 

^Local recovery means the merged clients exchange whatever missing in 
the packet set that they collectively know so that they share the same common 
knowledge and can be treated as a single entity. 
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Hi = {pi. P3, P4, P6, Pt} Hu = {pi.ps.pe} 


Fig. 1 . An example of CDE system where there are four clients that want 
to obtain eight packets. 'Hj is the has-set of client j. 


II. System Model and Problem Statement 

Let V = {pi,...,pi} be the packet set containing L 
linearly independent packets. Each packet p^ belongs to the 
finite field F,. The system contains K geographically close 
clients. Let K. = be the client set. Each client 

j € JC initially obtains T-Lj C V. Here, T-Lj is called the has- 
set of client j. The clients are assumed to collectively know 
the packet set, i.e., = 'P- The P2P wireless links 

between clients are error-free, i.e., information broadcast by 
any client can be heard losslessly by all other clients. The 
clients broadcast linear combinations of the packets in their 
has-sets in order to help each other recover V. Eor example, in 
the CDE system in Eig.[T] client 1 broadcasting pi +P 6 helps 
client 2 and client 4 recover pe and pi, respectively. Assume 
packet-splitting is not allowed. Let r = {ri,...,rK) be a 
transmission strategy with Vj G No being the total number of 
linear combinations transmitted by client j. We call ’’i 

the sum-rate of strategy r. Let the universal recovery be the 
situation that all clients in K. obtains the entire packet set 
V. The problem is to find a minimum sum-rate transmission 
strategy, a strategy that has the minimum sum-rate among all 
strategies that achieve universal recovery. 


determined by Q 


ac — max 


{[ L 


l^sl — 


W 5 is a partition 


AgWs 


IW5I-1 

of S that satisfies 2 < IW 5 I < |<S||- (1) 


([T]i is based on the condition that vx > l^sl - I^s\aI must 
be satisfied for all A” C 5 for the local recovery in tS ifSlFI 
An equivalent interpretation of ([T]) is that aj is the minimum 
integer that satisfies 


ctj < min{ ^ (aj — {Hsl + I'Ha’I) : W 5 is a partition 
XGWs 

of S that satisfies 2 < iWs] < |<S||- (2) 

Proposition 3.1: In an NPS-CDE system, let S C 1C, 
Aas = EagW 5(«5 - + l^-xl) - a*g and X' be any 

subset in W 5 . A strategy that achieves local recovery in S 
satisfies 


ta = aj - \ns\ + \'Hx\yX G Wl \ X', 
rx' = ag — -I- |Ha| — Aa^. 

Proof: The constraint conditions {rx > ms\ - 
I^SVaIiVA” C IC,ric = aj} are equivalent to {vx < 
aj — IH 5 I -I- |Ha|, VA C 1C, vjc = aj}. Among all these con¬ 
straints, the tightest ones are {rx < aj — IH 5 I + |'Ha|, VA C 
= ctj}; and the excessive rate can be reduced 
from any client set in W^. So, proposition holds. ■ 

It can be seen that the universal recovery is also the local 
recovery in 1C, i.e., ([T]i and Proposition 13.11 can be applied 
for universal recovery by letting S = 1C. We call W 5 the 
minimum sum-rate partition for the local recovery in S. Let 
W 5 be the maximizer of ([III. It should be noted that and 
W 5 are not necessarily equal and W 5 can not be used for 
determining the minimum sum-rate for the local recovery in 
S. See the Example 14. II in the next section. 


III. Minimum Sum-rate Strategy 

In this section, we first clarify the notations, or definitions, 
that used in this paper and then discuss how to determine the 
minimum sum-rate and a minimum sum-rate strategy. 

Denote Wx: a partition of the client set /C0Let |Wx|bethe 
cardinality of Wx- We call Wx a |Wx|-partition of IC. For 
example, Wx = {{1; 2}, {3}, {4}} is a 3-partition of client 
set 1C = {1, 2,3,4}. Let y C Wx- We call y the k-subset of 
partition Wx if |3^| = k, e.g., {{2}, {3,4}} is a 2-subset of 
partition Wx = {{1}, {2}, {3,4}}. Let 3^ = Uxi^yX, e.g., if 
3^ = {{2}, {3,4}}, 3 ; = {2,3,4}. 

For S C K., denote 

We define the local recovery in S as the situation such that 
all clients j C S obtain Hg. For example, in Fig. [T] for S — 
{3,4}, the problem of local recovery is how to let both client 
3 and client 4 obtain the packet set {3,4} = {pi, P3, P5, Pel- 
The minimum sum-rate aj for the local recovery in S is 

^A partition Wx satisfies Xr\X' = % and ~ ki 

for all X,X' e Wx. 


IV. Errors in Divide-and-conquer Algorithm 

The authors in H proposed a divide-and-conquer (DV) 
algorithm for finding the minimum sum-rate strategy in NPS- 
CDE systems lil In Theorem 1 in a, it states that the minimum 
sum-rate for the local recovery in S is given by 

o r l^sl ~ . .. 

ag = max | ^ ———- - — : Ws is a partition 

of S that satisfies 2 < jW^I < |<S||. (3) 

In Lemma 1 in a, it states that the minimum sum-rate 
transmission strategy for the local recovery in S can be 
determined by 

Y,rj=a°g-\ng\ + \nx\yXGW°g, (4) 

J&x 

where W^ is the maximizer of ( 0 . However, in most of 
the cases, ag is not an integer and Lemma 1 in a is not 

■^A brief proof of 0 is given in Appendix [aI 
^See details of DV algorithm in Appendix IbI 
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correct. For NPS-CDE systems, the minimum sum-rate must 
be an integer since every client must transmit integer number 
of times. So, determined by Q can not necessarily be 
the minimum sum-rate. It should be round up to a closest 
integer as in (|T])@ One may suggest replacing by aj in 
dUi. However, if so. Lemma 1 in a does not hold. See the 
example below. 

Example 4.1: Consider a CDE system in Eig. [T] Eor the 
universal recovery, the maximum and the maximizer of 
© are a°s = 13/3 and = {{!}, {2}, {3}, {4}}, re¬ 
spectively. The corresponding transmission strategy is r = 
(7/3,4/3,1/3,1/3) by using (|4|i. This strategy can not be 
implemented in an NPS-CDE system. Therefore, Lemma 1 in 
a is not correct in this case. In addition, if we use aj instead 
of a°g in a. we get r = (3, 2,1,1), which achieves universal 
recovery but has a sum-rate greater than = 5, i.e., it is 
not a minimum sum-rate strategy. Therefore, Lemma 1 does 
not hold, either. One may think that reducing 2 transmissions 
from any client in strategy r = (3, 2,1,1) will result in a 
minimum sum-rate transmission strategy. This is also not true. 
Eor example, if we reduce the transmission rate of client 1 by 
2, we get r = (1,2,1,1). It has sum-rate equals = 5 . 
But, the universal recovery is not achievable since constraint 
ri > L — |7f{2,3,4}| = 2 is breached. In fact, the correct way 
is to break K, into = {{1, 2, 3}, {4}} and determine the 
individual rates of the clients in {1,2,3} for the local recovery 
in (1, 2, 3}0 We will show that this can be accomplished by 
IM algorithm in Example 15.11 in the next section. 


V. Iterative Merging Scheduling Method 


In this section, we propose a greedy scheduling method 
for the universal recovery in CDE systems. We assume that 
the clients in CDE system can form coalitions, or groups. 
A coalition can contain just one client, and each client must 
appear in no more than one coalition. Any form of coalition 
in K. can be represented by a partition Wfc, and any fc-subset 
y of yVic contains k coalitions in Wk- The idea of this 
scheduling method is to iteratively merge coalitions and check 
if condition © holds. 

Let a be a lower estimate of a)(-, e.g., the lower bound 
on a)(- proposed in ©, Q. At the beginning, we assume that 
each client forms one coalition, which can be denoted by a AT- 
partition Wk. = {{/}: 3 S ^}- We start an iterative procedure. 
In each iteration, we perform two steps: 

1. If a > iteration, increase 

a by one and start the IM scheduling method (from K- 
partition) again; Otherwise, go to step 2. 

2. Let k € (2, • • • , |>Vx;|}- We choose y a. fc-subset with 
the minimum value of k that satisfies the conditions 


E 

x&y 


\Hy\-\Hx\ 

13^1-1 


-\- Li — 


(5) 


^In fact, determined by (5) is the minimum sum-rate for CDE systems 
that allow packet-splitting (PS-CDE). There is a study in m shows how to 
determine minimum sum-rate for both PS-CDE and NPS-CDE systems. 

^See the explanation in Appendix [C] 


E 


\'Hy\-\Hx\ 

13^1-1 


+ L-\Hy\ 


^E 

x^y 


\Hy,\-\Hx\ 

1^1-1 


+ L-\Hy,\, 


( 6 ) 


for all other subsets y' such that |3^| = \y'\- Achieve local 
recovery in y, and update Wjc by merging all coalitions 
in y into one coalition. 

The iteration terminates whenever we find that |Wjc| = 2 or 
there is no fc-subset y satisfies conditions © and © in step 

2 . 

Consider step 1. As discussed in Section HIH if we find that 
condition 

a< ^ {a-L+\Hx\) (7) 

AeWK 


does not hold for some partition Wjc, it means a < 
and universal recovery is not possible with the sum-rate a. 
Therefore, a should be increased. 

In step 2, the interpretations of the conditions © and © are 
as follows. Based on Condition ©, y must be the minimum 
sum-rate partition for the local recovery of the collectively 
known packets in y, i.e., y = @. So, J^x^y 

incurs the minimum sum-rate for the local recovery in y. 
L — \Hy\ is the number of collectively missing packets the 
recovery of which relies on the transmissions in client set 
)C\y. If condition © is breached, it means that universal 
recovery with sum-rate a is not possible if the coalitions in y 
are merged to form one coalition y. Therefore, it is better for 
them to work individually than together. Condition © means 
that y require less number of transmissions for the recovery 
of both collectively known and collectively missing packets 
than any other y' such that |X| = |y|. 

Example 5.1: Consider the CDE system in Eig. [T] and 
assume packet-splitting is not allowed. Let a = 5 and apply 
IM scheduling method. We get the procedure below. 

• Assume that each client works individually at the be¬ 
ginning and initiate Wjc = {{1}, {2}, {3}, {4}}. In this 
case, we have “ T + iHxl) = 7 > a, 

we continue to step 2 to consider conditions © and 
© to determine which coalitions should be merged. 
It can be shown that there is no 2-subset but one 3- 
subset {1, 2,3} satisfies both conditions. Therefore, coali¬ 
tions {1}, {2} and {3} should be merged to form one 
coalition {1,2,3}. Consider how to achieve the local 


{1,2,3} 


recovery in {1,2,3}. It can be shown that 

rEAe{{iU 2 }.{ 3 }} |lm:{'2}.'{~3H | -i 1 = 5 and the mini- 
mizer of © is 2 3 } ~ {2}, {3}}- In this case. 


Aa 


{1,2.3} 


= E 


agw 


{1,2,3} 


(“{1,2,3} “ 1^51 + \7ix\) - 
u:{i 2 3 } = 1- According to Proposition 13.II we choose to 
subtract Aa{i 2 , 3 } from the rate of client 3 and get rates 

^1 =“{i.2.3}-|^{1.2,3}| + |7fi| =3, 

^2 = a}i,2,3}-|H{l,2,3}| + |7f2|=2, 

T 3 = 'T{i,2,3} ~ |7^{1> 2 ,3}| + iTLsl — Aa{i_2,3} = 0 - 

^We will show that this is the case in the proof of Theorem ED in 
Section EH 
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Fig. 2. The merging process results from iterative merging (IM) algorithm 
and dividing process results from divide-and-conquer (DC) algorithm when 
they are applied to find the minimum sum-rate strategy in the CDE system 
in Fig. [2 Note, final merging to one coalition {1,2, 3, 4} does not happen 
but is implied in the IM algorithm. In each figure, the minimum sum-rate 
is shown beside the coalition {1,2,3, 4}, and the rates of clients in 
minimum sum-rate strategy are shown beside singleton coalitions. Note, the 
strategy determined by DC algorithm can not be implemented in an NPS-CDE 
system. 


. For Wic = = 

6 > a. However, we do not need to determine the merg¬ 
ing candidates since the 2-partition will be necessarily 
merged to form coalition {1, 2, 3,4}. It is straightforward 
to see that coalition {1,2,3} transmitting 4 times and 
coalition {4} keeping silent achieve universal recovery. 
But, there are already 5 transmissions in {1,2,3} when 
achieving local recovery, which means that client 4 
has recovered the missing packets by listening to the 
transmissions for the local recovery in {1,2,3}, i.e., 
r = (3, 2, 0,0) achieves universal recovery. 

We will show that r = (3, 2,0,0) is a minimum sum-rate 
strategy and a)}- = 5 in Theorem l5.3l in the next sections. Note, 
this procedure also shows a method to determine a minimum 
strategy: allocate the transmission rates for local recovery 
in each merged coalition. In Fig. |2] we show the merging 
and dividing processes incurred by IM and DV algorithms, 
respectively. 

Example 5.2: Consider applying the IM scheduling method 
in the CDE system in Fig. [T] with a — 4. For W/c = 
{{!}) {2}; {3}, {4}}, — L + = 3 < a. a 

will be increased to 5 in the first iteration and IM algorithm 
starts over again where the same procedure as in Example 15.11 
is repeated. 

A. Iterative Merging Algorithm 

We describe the IM scheduling method as the IM algorithm 
in Algorithms 1, 2 and 3. In Algorithm 1, Va is defined as 

Vc.{X)=a-L + \'Hxl (8) 

and a > equivalent to the breach of 

condition (|7|i- In Algorithm 2, 

U{y) = vc,{y)-Y,v^{x). ( 9 ) 

^a(y) < 0 and equivalent to condi¬ 

tions Q and respectively. 

Theorem 5.3: The IM algorithm returns and a minimum 
sum-rate strategy if the input a < 

Proof: Consider the Queyranne’s algorithm 10 

M :=MU{e} 


Algorithm 1: Iterative Merge (IM) 


input : Q, a lower bound on 

output: updated a, a transmission strategy r 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 


a = max{a, EjgK “ I'^il “ I’W/CXO}!}; 

initiate a -partition W/c = {{j}: j G ^} and a A-dimension 
transmission strategy r = ( 0 , ■ • • , 0 ); 

repeat 

U = FindMergeCand(WA:, a); 
r = UpdateRates(r, W); 
update W/c by merging all A G if; 
if a > ^.x^w^MX) then 
a = a -I- 1; 

terminate ‘repeat’ loop and go to step |2 

endif 

until I W/c I = 2 or W = 0; 
r = UpdateRates(r, Wk); 

Ar = max{r/c — a, 0}; 

choose j' £ y such that Vji — {L — \'HK.\{j'}\) > 
rj' = ry - Ar; 


Algorithm 2: EindMergeCand (find merging candidate) 

input : a partition of client set W/c. sum-rate a 
output: U, a set contains all candidates for merge 

1 A: = 1; 

2 repeat 

3 fc = fc -I- 1; 

4 2 = {y-. ^a(y) < 0, 3^ is a fc-subset of Wk}; 

5 if .Z / 0 then 

6 I U^y,where^c,(y)<^c(y'),Vy'e2; 

7 endif 

8 until k — I W/c I — 1 or Li is assigned (i.e., Z 7 ^ 0J; 


where e = argmin{?;Q(AI U {u}) — Ua({it}) : u G IC \ M}. 
Let W/c be a partition generated by the IM algorithm. For 
any X G W/c such that X is not a singleton, if we start 
the Queyranne’s algorithm with = S C X, we will 

get Afd'^l-l'SI) ^ A0 Due to the crossing submodularity of 
vc Q, at any iteration m G {2, • • • , iC — 1} of Queyranne’s 
algorithm JU 

t/«(W((™))+t;„({j}) <t^a(A^^’"n>S)+u„(5U{j}), (10) 

for all j G /C \ and S such that 0 7 ^ 5 C 

Also, the clients in y merges only if (V) < 0. W/c satisfies 
Ea'sWk 'i’a{X) < VaiX) for all other such that 

|W/c| = |Wj{;|. Alternatively speaking, W/c generated by the 
IM algorithm incurs the minimum values of X^A'gW/c '^^(A’). 
So, if a < X^A'gW/c ^c((A) holds for all W/c in IM algorithm, 
it means universal recovery is achievable with sum-rate a. 
Since a is increased by 1 if condition a < Y^xgW/c 
is breached, the output must equal to if the the input a < 

»tl3 

Consider an NPS-CDE system having \U\ clients and bas¬ 
sets ^lA. Based on (fT^ , we have lA = 

^See Appendix [D| for the proof and examples. 

^^See the examples in Appendix IeI 

^^Also note that after step-in IM algorithm, condition 0 holds for all 2- 
and A"-partitions of /C. Therefore, we do not need to check condition [7] for 
2- and i^-partitions in the rest steps of IM algorithm. 
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Algorithm 3: UpdateRates (update rates) 

input : merge candidate set lA, transmission strategy r 
output: updated transmission strategy r 

1 “j; — I l^xey I’ 

2 Aay, = ~ \'^y\ ~ l^-vl) “ cty’ 

3 choose X' £y such that the rates of clients in X' have not 
been assigned; 

4 forall the X a U Ao 

5 R — ay — \'Hy\ — [Hx^, 

6 it X = X' then R = R — Aay Ar = max{i? — rx, 0}; 

7 Tji = Tji + Ar, where j' is the client that is randomly 
chosen in set X\ 

8 end 


According to ©, in UpdtateRates algorithm, Ar for each 
X gU determines the number of transmissions required from 
coalition X for the local recovery in U in addition to the local 
recovery in X. The local recovery is achieved in every merged 
coalition in IM algorithm. Steps [T3] to [15] in IM algorithm are 
to reduce the excessive rates max{i? — tx, 0 } from the client 
j' such that the current rate r^/ is greater than L — \'Hx.\{i'}\^ 
the lower bound on the rate of client f for universal recovery. 
Therefore, the output r achieves universal recovery and has 
sum-rate equal to a^. ■ 

VI. Complexity 

The complexity of the IM algorithm depends on two aspects. 
One is how close the input lower bound a is to a^, since 
the IM algorithm will be repeated for a — + 1 times 

until it updates a to The other is the complexity of 
FindMergeCand algorithm which may vary with different 
NPS-CDE systems. For example, if FindMergeCand returns U 
containing 2-subsets, /3 is 0{K‘^ -j). Here, 7 is the complexity 
of running the cardinality function \T-Lx\- The authors in 
El also proposed a deterministic algorithm with complexity 
0{K ■ SFM(iT)) for searching the the minimum sum-rate and 
minimum sum-rate strategy in CDE systems. Here, SEM(iT) is 
the complexity of solving a submodular function minimization 
problem. To our knowledge, the algorithm proposed in na 
has the lowest complexity of SEM(Ar) is 0{K^ ■ 7 -f K^). 
An experiment in ||5l shows that the actual runtime by using 
MATLAB code is 4 ■ 10“^ ■ seconds on average. 

We run an experiment to show the actual complexity of the 
IM algorithm. We set the number of packets L = 50 and vary 
the number of clients K from 5 to 120. Eor each value of K, 
we repeat the procedure below for 100 times. 

■ randomly generate the has-sets T-Lj for all j G K. subject 
to the condition = V\ 

• set a to be the lower bound on derived in ijT); run 
the IM algorithm in MATLAB. 

In each repetition, we count the actual complexity in terms of 
7 and runtime (including the complexity of using algorithm in 
Q to determine the lower bound on a0. We plot the average 
complexity over 100 repetitions in Eig. El It shows that the 
average complexity is about - 7 ). The runtime of the 

IM algorithm is less than that of the deterministic algorithm 
in El when the number of clients is no greater than 94. 



20 40 60 80 too 120 

K, the number of clients 



20 40 60 80 100 120 

K, the number of clients 


(b) The average complexity in terms of runtime in MATLAB 

Fig. 3. The average complexity over 100 repetitions in experiment in 
Section 


VII. Conclusion 

This paper proposed an IM algorithm that found the mini¬ 
mum sum-rate and a minimum sum-rate strategy in NPS-CDE 
systems. The IM algorithm started with a sum-rate estimate, a 
lower bound on the minimum sum-rate. It recursively formed 
client sets into coalitions and updated the estimate to the 
value of minimum sum-rate. We proved that a minimum sum- 
rate strategy could be found by determine individual rate for 
achieving local recovery in each merged coalitions in the IM 
algorithm. Based on experiment results, we showed that the 
complexity of the IM algorithm was lower than the complexity 
of existing algorithms when the number of clients is below 94. 
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Additional Pages (Appendices) 

Appendix A 


Eq. ([T]l is based on the condition for the local recovery in 

<S 0: 

rx>\Hs\-\Hs\x\,yX CS, (11) 


which states that the total amount of information sent by set 
S \ X must be at least complementary to that collectively 
missing in set X. Based on (fTTI) . we have 


a5> E i\'Hs\-\'Hx\),yWs. (12) 

xeWs 


Likewise, > {Tisl — iHxl should also be satisfied for 

all X CS. We have 


> E 

xeWs 


I'^gl — \T~l.x\ 

IW5I-I 


,yx cs. 


(13) 


It is shown in Q that T.xeWs ^ T.xeWs^\'^s\- 

iTixl), i-e., constraint (fT3l) is tighter than (fTSl i. Also, because 
packet-splitting is not allowed in an NPS-CDE system, aj 
must be an integer, we have O- 


Appendix B 

The divide-and-conquer (DV) algorithm iteratively divide 
non-singleton elements in the current partition by calling a 
1-MAC function. The function 1-MAC(<S) returns two outputs: 

and Wg, the maximum and maximizer of Q, respectively. 
The algorithm is shown in Algorithm 4. 

In Algorithm 4, Rx = c^s ~ l^sl + \'^x\ is supposed to 
determine the sum-rate in X for achieving local recovery in 
5, which is based on Lemma 1 in ||4j that the minimum sum- 
rate transmission strategy for the local recovery in S satisfies 
r;t = - \'Hs\ + \'Hx\ for all A' S Ar = Rs - aj 

calculates the difference between the sum-rate in S that is 
required for achieving universal recovery in K. and the sum- 
rate in S for achieving local recovery in S. Based on Theorem 
3 in El, Ar > 0 and it can be added to any set in W 5 . 
The DV algorithm is repetitively called until the rate of each 
client is determined. It is claimed in El that r = DV(/C) is 
the minimum sum-rate strategy for an NPS-CDE system0 
However, the counter example in Section IIV] shows that it is 
correct. In fact, one can show that r = DV(A^) is the minimum 
sum-rate strategy for a PS-CDE system instead of NPS-CDE 
system. 


Appendix C 

= {{1},{2},{3},{4}} = {{j}: j G JC} implies: 
Among all constraints rx > L — 'Hic\x for all A” C /C (for 
the universal recovery), the tightest constrains are fACVlj} 

L - for all j G /C0 Based on ([T]i, is an integer such 
that 


“K > E 

X^Wk. 


L-\Hx\ 

|Wic|-l 


(14) 


^^By calling DV(/C), /C will be assigned to the first input argument S. Rs 
is not used if 5 = 

^^Alternatively speaking, a minimum sum-rate strategy must satisfy Vj > 
L — R)c\{j} ^ L — R-ij} for all j £ )C and rjc = 





7 


Algorithm 4: DV (divide-and-conquer) 
input : S, Rs if S ^ 1C 

output: {Rj : j € <S), where Rj determines transmission rate 
of client j 

1 initialize Ar = 0; 

2 (ag, W^) = 1-MAC(5); 

3 if 5 / /C then Ar = Rs — 0:5 forall the X e VVs do 
Rx = ot% — \Hs \ + I'Ha’I randomly choose X' £ do 
Rx' = Rx' + 

4 forall the X £ W5 incA t/iat X is not singleton do 

5 I {Rj j G X) =DY{X,Rx)-, 

6 end 


for all yV/c such that W/c is a partition of K. that satisfies 
2 < |>Va:| < K. Equivalently, 


XgWk. 


for all Wa: such that 2 < |Wa:| < K, where Va{X) = a — 
E + I "Ha: I- In the NPS-CDE system in Example 14.11 we have 


E 

XgWk. 


L-inxl 

IWkI -1 




1 

|Wic|-l 


for all Wic such that |>Va:| > 2 and L —11-1x1+L—\'H]c\x\ = 
a'^ — 1 for all X £ One can show that 


t;„(/C\ A') =min| Y Wa(5): >Vac\a: is a 
5GVV/c\Ar 

partition of /C \ A"! (16) 

forall A” £ = {{!}, {2}, {3}, {4}}. Eor example, let A” = 

{4}. Based on Xiyex; ^ and L - |?f{i. 2 , 3 }l + 

L — \H 4 \ = — 1, we have 


L-\ni\+L-\li2\+L-\nz\ < ■da*^-L+\li4\- 1 

= 2a^ + L — |H{i, 2 , 3 }I) 


which is equivalent to w„({l,2,3}) < Vo 


+ t^a({2}) 


Va(|3|). Based on — ^ ^^^ < 

we can prove that Ua({l,2,3}) < Ua({l,2}) + Uq,({ 3}). By 
this method, one can show that Uq({ 1,2,3}) < Ua({l,3}) + 
z;a({2}) and Ua({l,2,3}) < t;a({2, 3})+Ua({l}). According 
to Proposition 13.11 we can choose any j £ /C to break 
{ 1 , 2 ,3,4} to {K. \ {}},{}}} and consider how to achieve 
local recovery in /C\{j}. Eor example, if we break client set to 
{{1, 2, 3}, {4}}, based on Proposition 13.II we get r^^ 2 , 3 } = 5 
and rs = 0. Then, consider the individual rates in {1,2,3} 
for the local recovery in {1, 2, 3}. We get ri = 3, r 2 = 2 and 
r 3 = 0. One can show that (3, 2,0, 0) is a minimum sum-rate 
strategy. 


Appendix D 

The Proof and Examples of = A” by 

Starting Queyranne’s Algorithm with 
0 = 5 c A” in the Proof of Theorem I5.3I 

Let S C 1C such that |iS| < K — 2. We have 
Va{S U {u}) - Va{{u}) = \ UygS Hj \ - \Uu O {L>j^s'Hj)\. 


So, Va{S U {u}) — Ua({u}) < (iS U {u'}) — Va{{u'}) is 
equivalent to 

\Hu n {Uj^sHj)\ > \Hu' n {Uj^sHj)\- 

Let Wic be the partition of K. that is generated by IM algorithm 
(at any iteration). Eor any X £ Wx;, since the clients u' £ 
/C \ A” is not merged to X, Va{S U {it}) — Uq({u}) < Ua(5 U 
{u'})—UQ,({^i^}), for all 0 7 ^ 5 C A, It £ A\iS and u' £ 1C\X. 
Eor example, in Example 15.II we have Wx; = {{1, 2,3}, {4}} 
in the second iteration. Consider X = {1, 2, 3}. One can show 
that iHin^l > 1^2 0^41 and \{Hi\JH 2 ) fiHa\ > |(?fiU 
H 2 )nH 4 | 0 They are equivalent to i!q({ 2}U{1}) < Ua({2}U 
{4}) and ^^({l, 2} U {3}) < «„({!, 2} U {4}), respectively. 

Therefore, if = S, we will get = A at the 

|A| — |iS|th iteration. Eor example, for Wk = {{1, 2,3}, {4}} 
in Example 15.11 and A = {1,2,3}, it can be shown that: If 
we start the Queyranne’s algorithm with M.Cf) = { 1 }^ | 2 } or 
{3}, we will get M.C+ = 2 , 3}; If we start the Queyranne’s 

algorithm with M’+'i = {1,2}, {2,3} or {1,3}, we will still 
get AfW ={1,2,3}. 


Appendix E 

Examples of Wk generated by the IM algorithm 

INCURRING THE MINIMUM VALUES OF ^a(A) 

Example E.l: Consider the NPS-CDE system in Eig. [T] We 
get Wk = {{1i 2,3},{4}} in the second iteration of IM 
algorithm. By applying Queyranne’s algorithm with different 
we have the following results: 

• If = {1} or = {3}, then = {1,3} and 

= {1, 2, 3}. According to (fTol i. we have 

ri;,,({2}) + i;«({l,3,4}) 

u„({l,2,3})+u„({4}) < K,,({2,3 })+u«({1,4}) . 

[i;c,({l,2})+i;„({3,4}) 

(17) 

• If = {2}, then = {1,2,3}. According to 

Coll, we have 

u„({l,2,3})+u„({4}) < i;„({l,3})+u„({2,4}). (18) 

• If = {1,2}, then = {1,2,3}. According to 

Coll, we have 

u„({l,2,3})+u„({4}) < i;„({3})+u„({l,2,4}). (19) 

• If = {2,3}, then = {1,2,3}. According to 

Coll, we have 

u„({l,2,3})+u«({4}) < i;„({l})+i;„({2,3,4}). (20) 

i;q({1,2,3}) + i;q({ 4}) and the right-hand-sides (RHSs) of 
Eqs. CtI i to ( I 20 I 1 are the values of 
all partitions Wx; of {1,2,3,4} such that |yVx:| = 2. 
Therefore, iia({l,2,3}) + i;a({4}) is the minimum value of 
TIiXgWk ^mong all 2-partitions. 

show two examples of inequalities that can be derived based on 
Wx = {{1, 2, 3}, {4}} and X = {1,2,3}. There are in fact many other 
such inequalities, e.g., I'Hi n 'Hz\ > \'Hz G 7^41, 1(771 U Tfa) n 772| > 
|{77i U773)n774|. 
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Example E.2: Consider an NPS-CDE system that contains 
5 clients. They want to obtain a packet set that contains 10 
packets. The has-sets are 

'Hi = {P5,P7,P10}, 

^2 = {Pl, P2, P5, P6, P7, Ps, Pg}, 

% = {Pl, P3, P5, P6, P7, Ps, P9, Pro}, 

'Ha = {Pl, P3, P4, Ps, P6, P7, Ps, Pq}, 

H 5 = {P3,P6,PS,P9}- 


one can show that r;„({3}) + Va{{l,2,4}) + w„({5}) and 
z;q({ 3}) +t;a({l}) + t;a({2,4, 5}) at the RHS in (1^ incur 
the minimum values of 3-partitions 

of /C = {1, 2, 3,4, 5} that contains a singleton {3}. 

Therefore, Uq({2,3,4}) + Uq({1}) -I- Ua({5}) is the min¬ 
imum value of J^xeWic 3-partitions of K. = 

{1,2,3,4,5}. 

Appendix F 

Another Example of IM Algorithm 


We get W)c = {{3,4}, {1}, {2}, {5}} in the first iteration and 
Wk. = {{2, 3,4}, {1}, {5}} in the second iteration of the IM 
algorithm. Consider the partition Wtc = {{2, 3,4}, {1}, {5}} 
in the second iteration. By applying Queyranne’s algorithm 
with different we have the following results: 

. If = {3} or = {4}, then = (3,4} and 
= {2,3,4}. According to (fTOl l. we have 

z;a({2,3,4}) -|-r;„({l}) -|-Uq,({5}) 

Wa({2}) -I- ^^^({l, 3,4}) -I- Ua({5}) 

Pa({2}) -|-Ua({l}) -|-Ua({3,4, 5}) 

Ua({2,3})-f t;«({l,4})-f Ua({5}) 

“ Wq,({ 2,3})-|-Ua({l})-|-U q,({4, 5}) 

4}) -f ■P«({1, 3}) -f t;a({5}) 

Aa({2,4}) -f ^^({l}) -f r;«({3,5}) 

• If = {2}, then = {2,3,4}. According to 

Co}, we have 

Ua({2,3,4}) -|-Uq,({ 1}) + Ua({5}) 

^ fua({3,4})-f z;a({l,2})-f Ua({5}) 

“ \ua({3,4}) -f Ua({l}) -f Ua({2,5}) 

• If — {2,3}, then = {2,3,4}. According to 
Co}, we have 


z;a({2,3,4}) -|-Ua({l}) -|-Wq,({5}) 

^ f l'a({4}) + ■Pa({l, 2, 3}) -f 'Ua({5}) 
~ 11^«({4}) -f ^^({l}) -f Va{{2, 3, 5}) 


• If = {2,4}, then = {2,3,4}. According to 
(doll, we have 


z;a({2,3,4}) -|-i;„({l}) -|-Wq,({5}) 

< fwa({3})-f t;„({l,2,4})-f Ua({5}) 

~ \l'a({3}) + I^a({l}) + Va{{2, 4, 5}) 

The RHSs of Eqs. dJB to {24} contain a set of minimum 
values of example, consider the client 

subset {1,3,4, 5}. Since we Wk = {{3,4}, {!}, {2}, {5}} 
in the first iteration of the IM algorithm, one can show that 
z;a({l,3,4})-fi;a({5}) and Ua({l})+Wa({3,4, 5}) incur the 
minimum values of X]AeW{i 345 } over all 2 -partitions 

of {1,3,4,5}. So, z;„({2}y'+'uL({l,3,4}) + r;„({5}) and 
t^a({2}) -l-Ua({l}) + t;a({3,4, 5}) at the RHS in incur 
the minimum values of over all 3-partitions 

of /C = {1, 2, 3,4, 5} that contains a singleton {2}. Likewise, 


Consider a 4-client 8-packet NPS-CDE system with the has- 
sets being 

Hi = {P 3 , P 4 , P 6 , P 7 , Ps}, H 2 = {Pl, P 4 , P 7 , Ps} 

Hu = {P 3 , P 4 , Ps, P 6 , P 7 , Ps}, Ha = {Pi, P 2 , Pe}- 

We apply IM algorithm with input a = 6 and a = 5. The 
procedures are shown in Examples ED and IF.2I respectively. 

Example El: Let a = 6. We start IM algorithm. In steplT] 
we get a = 6. Then, we initiate TV^c = {{1}, {2}, {3}, {4}} 
and r = (0,0, 0,0). Then, we have the following procedure. 

• In the first iteration, we call FindNewPartition to deter¬ 
mine U. We first set fc = 2 and consider all 2-subsets. 
{{1}, {2}}, {{1}, {3}} and {{2}, {3}} are the 2-subsets 
y that satisfy ^a(3^) < 0. Since 

r -1 3 ^ = {{!}, { 2 }} 

ea(y) = <^-3 3^ = {{!}, {3}}, (25) 

[-1 3^ = {{2},{3}} 

FindNewPartition returns U = {{1},{3}} to IM algo¬ 
rithm. We call UpdateRates algorithm, where ri and 73 
in r is updated as ri = 0 and 73 = 1, respectively. So, 
r is updated as r = (0,0,1,0). We then merge sets {1} 
and {3} and update Wk. as Wk = {{1, 3}, {2}, {4}}. 
Because J2x&WK:'^e{X) = U6({1,3}) -f t;6({2}) -f 

U6({4}) = 7 > a for Wk = {{ 1 ,3}, { 2 }, {4}}, W ^ 0 

and |Wac| > 2, we continue the ‘repeat’ loop in IM 
algorithm. 

• In the second iteration, FindNewPartition algorithm re¬ 
turns U = {{1,3}, {2}}. When calling UpdateRates 
algorithm, we have Ar = 2 for {1,3} and Ar = 1 
for { 2 }. we choose ri to increase by two, and 72 is 
directly updated as 72 = 1. The transmission strategy 
is updated as r = ( 2 , 1 , 1 , 0 ), and Wk. is updated as 
^ic = {{1,2,3}, {4}}. Since |Wa:| = 2, the ‘repeat’ 
loop in IM algorithm terminates. Note, in this iteration, 
Ar = 2 for {1,3} means that there should be 2 more 
transmission from client set, or coalition, {1,3} for the 
local recovery in { 1 , 2 ,3} in addition to the local recovery 
in {1,3}. Also, since local recovery has been achieved in 
{1,3}, client 1 and client 3 have the same has-set at this 
moment. Therefore, Ar — 2 can be completed by any 
either of them. In this case we added Ar to client 1. But, 
it should be clear that local recovery in {1, 2, 3} can be 
achieved if we increase r^ by 2 or increase both ri and 
73 by 1. Since |>Va:| = 2, ‘repeat’ loop is terminated. 

• We call UpdateRates by inputting U — Wk. = 
{{1, 2, 3}, {4}}. We get Ar = 1 for {1, 2, 3} and Ar = 1 
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Fig. 4. The merging process results from iterative merging (IM) algorithm 
and dividing process results from divide-and-conquer (DV) algorithm when 
they ai‘e applied to find the minimum sum-rate strategy in the CDE system in 
Fig. [3 Note, final merging to one coalition {1, 2, 3,4} does not happen but 
is implied in the IM algorithm. In each figure, the minimum sum-rate is 
shown beside the coalition {1, 2, 3, 4}, and the rates of clients in minimum 
sum-rate strategy are shown beside singleton coalitions. Note, the strategy 
determined by DC algorithm can not be implemented if packet-splitting is 
not allowed. 

for {4}. We increase r 2 by one and set r 4 = 1. The 

transmission strategy is updated as r = ( 2 , 2 , 1 , 1 ). 

Since rjc = a, the IM algorithm finally returns a = 6 and 
r = (2, 2,1,1). It can be shown that 6 is the minimum sum- 
rate and ( 2 , 2 , 1 , 1 ) is one of the minimum sum-rate strategies. 

Example F.2: Assume that we apply the IM algorithm to the 
CDE system in Fig. [T] with a = 5. In step [T] we get a = 5. 
However, it can be show that Wic = {{1,3}, {2}, {4}} at the 
end of the first iteration and U 5 ({ 1 , 3}) -|-t; 5 ({ 2 }) -|-U 5 ({ 4 }) = 
4 < 5. ’repeat’ loop terminates, a is increased to 6 and the 
IM algorithm is started over again. With a = 6 , the same 
procedure as in Example IF. II is repeated. 

We then apply the DV algorithm (in Algorithm 4) to this 
NFS-CDE system. The procedure and results are shown in the 
following example. 

Example F.3: Consider the NPS-CDE system in Exam¬ 
ple IF. II The first call of l-MAC(Ki) returns = 6 

and = {{1, 2,3}, {4}}, which gives transmission rates 

-f^{l,2,3} = — L — |T({i^2,3}I = 5 -^{4} = ~ L — 

1 7 ^ 4 1 = 1. Then, the problem is to determine the exact rates 
of clients 1, 2 and 3. To do so, 1-MAC({1, 2,3}) is called, 
which returns a?, „ oi = 4 and W?, 901 = {|1,3|,{2}}. 
We get R,, 3 , - l«,S3,l'+ |H,3,3,I = 3 

and i?{ 2 } = «{i, 2 . 3 } “ l^{i. 2 . 3 }l + l^{ 2 }l = 1 for the 
local recovery in {1,2,3}. In this case, there’s an excessive 
rate Ar = R{i,2,3} — ct{i 2 3 } = 1 in set {1,2,3}. Ar 
will be added to any client in {1,2,3}, say, client 2, i.e., 
r 2 = r 2 -f 1 = 2. Then, 1-MAC({1,3}) is called. The 
results are gj = 1 and 31 = {{1},{3}}, which 
means i?{i} = 3 , - | 7 f{i, 3 }| + f'H{i}| = 0 and = 

*^{1 3 } ~ l^{i,3}l + 1^{3}I = 1 are sufficient for the local 
recovery in {1,3}. Let the excessive rate Ar = 2 be added 
to client 1. We finally get the minimum sum-rate strategy 
r= (2,2,1,1). 

We show the merging and dividing processes resulted from 
the IM and the DV algorithms in Fig. |4] It can be shown that in 
this CDE system DV algorithm returns the same results as IM 
algorithm. And, in this case, the merging process of the IM al¬ 
gorithm is exactly the inverse procedure of the dividing process 


of the DV algorithm. However, as explained in Section ITVl DV 
algorithm is not applicable to CDE systems that do not allow 
packet-splitting in general0 From Fig. |4] we can see another 
problem with DV algorithm is that it is a top-down approach 
which could not be implemented in a decentralized manner. 
On the contrary, IM algorithm is a bottom-up approach, which 
allows clients to learn the transmission rates in a minimum 
sum-rate transmission strategy in a distributed/decentralized 
way. 


*^One can show that DV returns a minimum sum-rate strategy for CDE 
systems that do not allow packet-splitting if all returns by l-MAC(ki) 
(in Algorithm 4) is a 2-partition. But, this is not necessarily the case in general. 


